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Agenda 


= Day 1 
— Welcome / intro / agenda 
— Introduction to IBM® Integration Bus 
— Applications and libraries 
= Data Format Description Language (DFDL) 
= Graphical Data Mapper 
= Business Decision Node 
— Integration Services 
¢ MQ Services 
¢« Database Services 
=" Day 2 
— WebSphere ESB conversion 
"= Workload Management 
— Policies 
— Web Admin/Analytics 
=» Wrap-up 
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Welcome to the IBM office 


¢ Access restrictions 


Restrooms 
Emergency exits 
Smoking policy 
Breakfast/lunch 
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Meet the IBM team ... 


Lets meet you!!! 


Your name? 


Your company/organization? 


Your job responsibilities ? 


e 
v ; 3 3 d 


what are your interests and expectations? 
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Introducing IBM Integration Bus 


" IBM's strategic integration technology 
— Single engineered product for .NET, Java and fully heterogeneous integration scenarios 
— DataPower® continues to evolve as IBM's integration gateway 
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" Mobile 


= A natural evolution for WebSphere Message Broker users 
— Significant innovation and evolution of WMB technology base 
— new features for Policy-based WLM, BPM integration, Business rules and .NET 


= Designed to incorporate WebSphere Enterprise Service Bus use cases 
— Capabilities of WESB are folded in to IBM Integration Bus over time 
— Conversion tools for initial use cases built in to IIB from day one 
— WESB technology remains in market, supported. Migrate to Integration Bus when ready 
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Product roadmap 


IBM Integration Bus V9 Q2 2013 
Policy-based Workload Management and Flow Management 





IBM's plans, directions, Web-based Visualization and Performance Analysis 
and intent are subject MQ and Database Service Discovery 
to change or withdrawal Business Rules and BPM Integration V9 FP1 Q4 2013 


.NET Input, Dynamics, MSMQ 

















Message Broker 
V8 FP2 Q1 2013 


Message Broker 
V8 FP1 Q2 2012 





Message Broker 
V8 Q4 2011 


Healthcare Connectivity Pack 
V8 Q1 2013 


Healthcare Connectivity Pack 
DICOM Medical Imaging 


V8 FP1 Q3 2013 





Web-based Operational Monitoring 
CDA Analytics and Reporting 
Message Broker V8 Exploitation 





Healthcare Connectivity Pack 
V7 FP2 Q1 2012 
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IBM integration themes 
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= Simple and productive 






















































































































































































































































































— Making it easier and quicker to develop and manage integration solutions 
¢ Learn, Develop, Deploy, Manage, Migrate quickly and easily 
































































































































































































































































































































































































































































































































































































































































































































































































































































































































































































































= Universal and independent 















































































































































































































































































































































































































































— Connecting to a range of different systems 









































































































































¢ Universal connectivity includes standards, de facto standards, industry and custom systems 











































































































= Industry specific and relevant 


























































































































































































































— Provide industry relevant connectivity packs to solve domain specific problems 
¢ Industry specific nodes, solution-oriented patterns and user-oriented tooling 

















































































































































































































































































































































































































































































































































































































































































































































































































































































































= Dynamic and intelligent 


— Allow the creation of dynamic solutions that provide business insight 
¢ Flexible configuration tools, analysis of data and intelligence 























































































































































































































" High performing and scalable 























































































































































































































— Provide a platform and technology neutral connectivity option 
¢ Work on the widest possible range of hardware, software and virtualized environments ~~ 
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IBM 


Integration Bus content Integration Bus 


IV/=)6s1 (eet, 





= Simple and productive 
— Graphical Mapper: Stored procedures, patterns and enhanced conversion of older maps 
— BPM Express/Standard (Lombardi) integration: Process Designer synergy and integrated deployment 
— Web tools: Real-time performance statistics for understanding system behaviour 


= Universal and independent 
— WESEB conversion: Import and conversion of mediation flows and “to do” list 
— MQ service discovery to facilitate sharing of service definitions 
Database discovery and analysis tools for diversified access to systems of record 
DFDL improvements including lengthkind “pattern” and enhancements for TLOG 
.NET Input node, Dynamics and MSMQ samples and patterns, support for Windows Server 2012 


= Industry specific and relevant 
— Healthcare Pack update: MB8 Exploitation, DICOM Imaging, Analytics with Netezza® and Cognos® 


= Dynamic and intelligent 
— Integrated workload traffic shaping policies to manage back-end system load 
— Managing unresponsive integration flows for improved overall system reliability 
— Business Decision Services using ODM technology for business rules integration 
— Security enhancements: Improved BasicAuth, Multiple certificates, CRL checking 


High Performing and scalable 
— Embedded cache extensions: External cache, expiry and SSL support 
— Flexible Cloud Provisioning with Pure, including Pure POWER® support 
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A broad range of supported platforms and environments 


= Broad range of operating system and hardware platforms supported 


— AIX, Windows, z/OS, HP-UX, Linux on xSeries, pSeries, zSeries, Solaris (x86-64 and SPARC), Ubuntu 


— Optimized 64-bit support on all platforms; 32-bit option available for Windows and x/Linux 
— new support for Windows 8 and Windows Server 2012; .NET CLR V4.5 included on Windows 
— Express, Standard and Advanced editions make IIB applicable for all solutions and budgets 

¢ All new V9 features available in all editions unless otherwise stated 


= Virtual images for efficient utilization and simple provisioning 
— Extensive support for virtualized environments such as VMWare, AIX Hypervisor... any! 
— IBM Workload Deployer for x/Linux and AIX 
— Support for Pure on POWER hardware to complement xLinux 
— SmartCloud and IBM Workload Deployer images for simplified solution provisioning 


= Includes access to full range of industry standard databases and ERP systems 
— DB2®, Oracle, Sybase, SQL Server, Informix, solidDB® 
— Open Driver Manager support enables new ODBC databases to be accessed 
— JDBC Type 4 for popular databases 
— SAP, Siebel, Peoplesoft, JDEdwards at no additional cost 


Virtual Machines 








= Technology components and prerequisites 
— Java 7 on all platforms v7 
— MQ 7.5 prerequisite (7.1 on z/OS®) a Aes 
IBM Workload 
= Detailed System Requirements Deployer 


— Posted on www.ibm.com/integration-bus 
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Traditional 


OS 


Public Cloud 








IBM Pure 
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Transfer licensing and modes of operation 


= Express: A limited set of nodes are enabled for 
use within a single execution group. Message flows 
are unlimited. __ Ful | 

apabiities 

= Scale: A limited set of nodes are enabled for sai 
use within unlimited execution groups. Message : 
flows are unlimited. 

=" Standard: _ All features are enabled for use with a cae — 
single execution group. The number of message ood mode | mode 
flows that you can deploy are unlimited. eee | | 

= Advanced: All features are enabled and no a - 
restrictions or limits are imposed. This mode is the Capacity "Capacity 
default mode, unless you have the Developer 
Edition. 


WESB 
Transfer 
Wexsvatsx> 


fANe\Vee] avecsve! s)s]alerel ae 
esas Wexslalsxs 


m0) fois 
Tlerslatsy>, 


jANa Ws] al esie im anele(s Standard mode 


IBM Integration Bus 
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Nodes in V9 — Cover many transports 





(=> WebSphere MQ 29 gl Web Services 4o BIC CICS a5 yas im 
24) MQInput (|) SCAPInput CICSRequest © JMSInput 
ae WiQRepl oe SOAP Bc) 
| — nee bcd IMSRequest 5? IMSReply 
EE MQGet San SOAPAsyncRequest - 2 JMSReceive 
ie) MQHeader a SOAP AsyncResponse LS CORBA Me IMSHeader 
Jms . 
= ior CORBARequest 
Jf MQOptimizedFlow (Depre... [y"| SOAPEnvelope ia JMSMOTransform 
Ss SOAP tract = WebSphere Adapters << __ 
&: HTTP « le cx ac | Ee MOQUMS Transform 
ae Se fe PeopleSoftinout 
|. HTTP Input od) RegistryLookup 22> PeonleSoftRequest is Email ot 
# HTT PReply an EndpointLookup wos j= EmailInput 
5+ UTTDRequest [sae SAPInput —— 
a CU TP ReQu ae || EmailQutput 
‘e H1 1 PHeader g= File ¢ sap SAPRequest — = 
ia HTTPAsyncRequest [3 FileInput si SAPReply 
| _ * “Il Cite. | es TCPIPClientinput 
ij HTTPAsyncResponse l FileOutput 5 SiebelInou: i " 
? [|S SiebelInput al 
Bp FileRead Pate El] TCPIPClientOutput 
Gap SCA ro = "ye SiebelRequest Ge TCPIPClientReceive 
| 4a FTEInput | 
lie aa A) FTEOutput be IDEdwardsInput 8 TcPIPServerinput 
SCARep ae Jardsk : | | 
. Spy i. ‘pe JbEdwardsRequest al TCPIPServerOutput 
sCARequest | | | 
EQUES CDInput ie TwineBallInput Eat TCPIPServerReceive 
tm SCAAsyncRequest Ell CDOutput o9 
= TwineBallRequest 
cits SCAASyncResponse © 2014 IBM Corporation 
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Nodes in V9 — Provide many functions 























G! Database * (Transformation 

|G Databaselnput ner NWETCompute 

Database aiinadisiaie 

“ay XSLTransform 

DatabaseRetrieve 2 Compute 

+o DatabaseRoute Se Javalom pute 
a! PHPCompute 

MY NET cf 

aa a Security 

[fy NETInput * (& SecurityPEP 


@f Business Decisions 


+” DecisionService 


 oét Validation 


* ~ Validate 


w Check (Deprecated) 


oe Ga Construction 


} »~ Input 
>a Output 


ffi: Throw 

i Trace 

! TryCatch 
EEN FlowOrder 
ie} Passthrough 





ota ResetlontentDescriptor 


gu Timer 
TimeoutControl 
in Timeouttatification 


= Additional nodes available as product extensions or SupportPacs 
— For example, WebSphere TX, VSAM, QSAM and others 
= And, you can create your own Custom Nodes in C or Java >>> 
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at Routing aa 
=> Filter 

#5] Label 

fl) Publication 
aT RouteToLabel 
Mc Route 


AggregateControl 
AgoregateReply 
Ely AggregateRequest 


Collector 
+e Resequence 
+" Sequence 


MyCustomNode 
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Applications and libraries 
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Applications and libraries organize your resources 


" Applications and Libraries encapsulate resources 


All resources required to solve a 


| Application 
connectivity problem 


Library 
A logical grouping of related routines 
or data 





" Toolkit and broker runtime 
— Make development and management easier 
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Features of applications and libraries 


"= Deployable containers of IIB resources 


— Message flows, subflows, message definitions (DFDL, XSDs), ESQL, JARs, XSL, 
Adapter files, etc. 


» Applications promote encapsulation and isolation 
» “Main” message flows and required components 
>» Deploy multiple applications to an execution group 
» Visibility of resource restricted to containing application 


» Libraries facilitate re-use 
>» Resources shared across applications 
» Message definitions, common subflows, etc. 
> Multiple libraries to group related resources 
» for example, by type or function 





15 Discovering what is new in IBM Integration Bus V9 © 2014 IBM Corporation 


IBM Software 


Applications and libraries organize your resources 


























AGS Broker Develo 2 _L. Patterns Explor ieee 1 . ; 
——— = Shown in Bus Development view 
<all resources> ~ | = List of referenced projects from 
Applications and Libraries Quick Starts... £7 | workspace 
o-S wanes — Projects are folders 
+), MyLibrary — Eclipse uses to contain / access files 
A MyOtherLibrary — “Integration Bus” project type 
¢ Contain anything IIB specific 
Projects New... © 
SiS MyAp ® Manage we project references eg 
ales MyAp | 
YAP 





I: i MyLib Check the projects to be referenced. Any other 
ea — | projects referenced from the checked projects will 
(4) MyLib) also be induded. Leaving a project unchecked will 
tee Myo prevent the projects from being induded, 


re Myod (= MyApplication_broker 
[_] tS MyApplication_ java 





al (=! MyLibrary _java 
al [2 MyOtherApplication java 


The follawina oroiects will alen he incloided as they 
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Broker Archive — Manage tab 










Application deployment contains: 
> Zip file of all XSD and WSDL from IB projects referenced from the 
Application project 

>» Deployable flows 

» Libraries referenced from application (directly or indirectly) 

>» MessageSet — dictionary and xsdzip of schema files for each message set 

project referenced trom Application 





Manage 
Rebuild, remove, edit, add resources 















 MyWMBAppica Application han 12, 2011 11:13:33 PM 19262 
_) My IMBAppication. xsd7ip XSD7IP fe kan 12,2011 11:13:32 PM 6809 
@ BuldShipParthequest.map MAP fle Rn 12, 2011 11:13:32 PM 4679 
*, Bul ShippedPoResponse.map MLA file han 12,2011 11:13:32 PM 4591 
BS OrderRejectedResponse map MA fle Ran 12, 2011 11:13:32 PM 4556 Complete Contents of 


SA) My SubfiewLibrary Library Jun 17, 2001 21:13:32 PM 2000 
mm MyESOLULbrary [ie Ubrary jan 12, 2011 11:13:32 PM 601 
+ Gl ProcessShipping.cmit Compled message fiw Jun 1?, 27001 11:13:39 PM Soa 
@ 0 MyWMBAppicatonFlov: Comped message fiw Jun 12,2021 11:13:32 PM SEb68 


the application that will 
be deployed in the 
application container 







Prepare | Manage! 









Library deployment contains: 
> Zip file of all XSD and WSDL from IB projects referenced from the 
Library project 

>» Deployable flows 

>» MessageSet — dictionary and xsdzip of schema files for each message 
set project referenced from library 
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Applications and libraries on the Integration Server 





4 122 Integration Nodes 
a 4 IBINODE 
» O® Configurable Services 
| a default 
4 4) AcctOpen_Application 

AcctOpen_Flow 

‘= AcctOpen_Flow_BuildRequest 

‘= AcctOpen_Flow_CreateReply 

4 By AcctOpen_Library 
IBMdefined'org\xmlsoap\schemas\soap\envelope\soapenv1l 
[BMdefined\soap 
WSDLVKE_IN Request 
WSDLKE_OUT_Response 
WSDLIJKE WSDL ServerService 
WSDLVKE WSDL ServerService 
WSDLVKE WSDL ServerService InlineSchemal 
4 BA MQ Service Library 
IBMdefined\CobolDataDefinitionFormat 
IKE Account 
» &) MQ Service 
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12 Integration Nodes FS Outline | V8 Data Source Explorer| ¥ Tasks 


¢ Deployed applications and libraries are displayed 
directly underneath the execution group in the 
Toolkit and IBX 
o Also available through CMP and masilist 


¢ GUI, command line and CMP tools updated to 
expose operations that are applicable to libraries 
and applications 
o Starting and stopping applications 
= Starting an application implicitly 
Starts all required message flows 
o Delete 
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Data Format Description 
Language (DFDL) 
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Data Format Description Language (DFDL) 
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Example — Delimited text data 


Separator 


si esac ic csc a a/c i Vm i vl sm Sm is cme Rv SG tr Vi UU Gl Vm mG Vn ml it Vt i 





separators, initiators (tags) and terminators are examples in DFDL of delimiters 
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DFDL features 


22 


Language structures such as COBOL, C and PL/1 

Industry standards such as SWIFT, HL7, FIX, HIPAA, X12, EDIFACT, ISO8583 
Fixed data and data delimited by text or binary mark-up 

Text data types such as strings, numbers, zoned decimals, calendars, Booleans 
Binary data types such as integers, floats, BCD, packed decimal, calendars, Booleans 
Bi-directional text 

Bit data of arbitrary length 

Pattern languages for text numbers and calendars 

Ordered, unordered and floating content 

Default values on parsing and serializing 

Nil values for handling out-of-band data 

XPath 2.0 expression language including variables to model dynamic data 
Speculative parsing to resolve choices and optional content 

Fixed and variable arrays 

Hide elements in the data 

Calculate element values 

Validation to XML Schema 1.0 rules 

scoping mechanism to allow common property values to be applied at multiple points 
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DFDL adoption 


= IBM DFDL reusable component ships with: 
— IBM WebSphere Message Broker 8.0 
— IBM Integration Bus 9.0 | 
— IBM Rational® Performance Test Server 8.0.1 ae pat ba | 
— IBM Rational Test Virtualization Server 8.0.1 ee 
— IBM Rational Test Workbench 8.0.1 
— IBM Rational Developer for System z 8.5 
— IBM InfoSphere® Master Data Management 11 





"= Further IBM products and appliances investigating adoption 


= Open-source DFDL implementation in progress (“Daffodil’’) 
— Available as an aloha release (parser only) 


— Partly funded by a major US government agency who are adopting DFDL as their 
Standard way to parse text and binary data 


= DFDL web community on GitHub for collaborative authoring of DFDL schemas for 
commercial and scientific data formats 
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DFDL Schemas web community GitHub e Explore Features 


DFDL Schemas for Commercial 
and Scientific Data Formats 


http-dfdischemas.githu... smh@uk.ibm.com 


= Free public repository 
for DFDL models 


" Hosted on the popular 
GitHub community website 


= Unlimited read-only access 

- NACHA xo 
" Col labo rat O n en CO U raged DFDL Schemas for NACHA 
a Evolving content Updated 23 days ago 





IBM4690-TLOG cee 
DFDL schemas for Transaction Log data emitted by IBM/Toshiba 4690 point-of-sale devices. 


Updated 3 months ago 


ISO8583 


DFDL schemas for ISO8583 


dfdischemas.github.com CSS #7 B 
Web pages for DFDLSchemas organization 


Updated 3 months ago 





This GitHub repository hold DFDL schemas that model |SO8583 credit/debit card data. There are ei L7 -y2 7 *6 Pb 
DFDL schemas for the two most popular release of the standard: _ 
DFDL schemas for HL? v2.7 
* (508583:1987 Updated / months ago 
® 1$08583:1993 (coming soon) 
This is a public repository that allows anybody to view the content. If you would like to contribute 
to this repository, email the address on the organisation home page. 
ISO8583 esp 
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IBM DFDL in IBM Integration Bus 


= IIB v9 uses IBM DFDL v1.1 component 2010 [Hans On JoFOL 
= DFDL domain and parser 

— Available in nodes, ESQL, Java 

— Use instead of MRM CWF/TDS 

— More capable and higher performing 






























a Adopts XM LN SC tree shape Configure schema for CSV data Ss} é 
. DFEDL mo dels | Provide settings for a new schema that will model CSV data. tT | 
— Schema files reside in IIB libraries ances: | | 
= Not In Message Sets Blank records: Select the record terminator. 
: ‘ ‘ \V| The first record is a head 
" Tooling for creating DFDL models in IIBTK — <7 
Field settings 
— Guided authoring wizards | DFDL Test - Parse: Runs the DFDL parser with the provided physical input data and 
— Language importer wizards Status: Parsing completed: Thu Jun 14 12:06:05 BST 2012 
— DFDL editor — 
- DFDL model debugger Data: /ST_DFOL_CSV/TestData. txt 
— Debug parsing and writing of data in IIBTK aoe ae 
Characters 
— No deploy to runtime necessary! i 2O09GSK IncaMBTR7, 429ace, VE" ES: 
= DFDL schema deployed in BAR file ee ee ill paaae a 
—No dictionary file I MQ Input Node Properties - SAMPLE ACE RSSDIF IN 53ec, -Ve "as 1436 fio 
; ; Description 
. Migration from v8 Basic Message domain DFDL: For binary or text messages with a Data Format Description L 
delaras iia Message model <DFDL schema files in Applications and Libraries> 
Parser Options 
Message Transaction 
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To open the DFDL schema Tile for the selected messaqe, click here... 





Validation 
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Creating a DFDL model 


= 


G) New Message Model (olka 


Create a new message model file 
> 


, New Artifact 
Create a new artifact, 









Select the message model type 


XML data for use in Web Services, 
All other XML data. 





Text and binary 


CSV text Comma Separated Values data, a delimited text format commonly used as an 
export format by spreadsheets and databases, 


©) Record-oriented text Text data formats where delimited fields are grouped into records. 
©) COBOL Data for COBOL programs 

Oc Data from C programs 

(©) Other text or binary — All other text or binary data formats. 


Fit Broker Schema 
1 fi) Adapter Connection 








Enterprise Information Systems 










() SAP Data from SAP systems induding IDoc and BAPI 
() Siebel Data from Siebel systems 
new launcher O Peoplesoft Data from PeopleSoft 
fo r Cre all N Q ©) ID Edwards Data from JD Edwards systems 
Integration Bus Select the 
project artifacts Other type of data 
©) CORBA IDL Data from CORBA 
©) Database record Records from relational databases yO U ql re , 
©) MIME Data for extended email format WO rki f g WI { n 
(IBM supplied Predefined data format 


= Or you can drop an existing DFDL schema into a Integration Bus library 
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Wizard options for creating a DFDL model 


© New Message Model - (eg 
CSV text , 
Choose how you would like to create your CSV message model, 
. G U | d e d a U t h O rl N Q WebSphere Message Broker requires a message model in order to parse, serialize and validate CSV data, A 
message model also speeds up development of your message broker applications by enabling ESQL content 
a 


af 


Using the DFDL editor Se am 
Importing from other metadata 
Already have DFDL schema 


Comma Separated Values data is modeled by Data Format Description Language (DFDL) schema files. DFDL is 
a standard from the Open Grid Forum for describing all kinds of text and binary data. 





Ai ee fille, ae using the DFDL schema editor 
©) Import or replace the IBM supplied DFDL schema property defaults for CSV. 










Select how you 
want to create 
the DFDL model 
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Creating a DFDL model using guided authoring 





| 
(Saye) be eee bee by |e — _ = 
(3 yey Te SS.aqa0eC | JL 


Configure schema for CSV data 
Provide settings for a new schema that will model CSV data. 








: 
i 
Ez 











Encoding code page options r _ a 
@ Dynamic (provide ED Ey = P & fe 

CO) Fixed WF-2 Test Parse Model Test Serialize Model Hide properties Show basic Show allsections Focus on selected Show quick ou tine 
Soba etn riessageRoots /@]| @@ * + %| BH 


A message root represents 4 message in your application. 





























| Name | Type = Min Occurs | Max Occurs | Default Value | | Sample Test Data 












































1. —! L 



































Generated 











tl 


model 


























28 Discovering what is new in IBM Integration Bus V9 © 2014 IBM Corporation 
































IBM Software 


Testing a DFDL model within the editor 


‘[B) Company.xsd 22 ‘Gj DDL Test -Logical Instance 23 






Parsed 
‘infoset’ 









ER Ea FS = & (2) & EF Data source: <From 'DFDL Test - Parse’ vie 
Test Parse Model Jest Serialize Model Hide properties Show advanced Show allsections Focus on selected Show quick outline Create logical inste 
Message root Company (/MessageModelingLiby 






* Message Roots je 





A message root represents a message 


Tree View ™ XML View| 








2 Name PA Value 
Name 0 a rs e r Max Occurs Default Value Sample Test Data =) Company 
=| [e] Company q CompanyName xs:string My Company 
= ral; ' 
(=) ses Sequence i 1 =| Employee | 
= : Empho xstinteger 111111 
[¢| CompanyName string 1 1 Dept ustinteger Soo 
[=| [e] Employee 1 unbounded Emphame xsistring Alice Wong 
[=] oes SEQUENCE 1 1 +] Address 
? Tel xeistring 905-347-5649 
EmpNo integer 1 1 1 - 
Le] Emp —_ Salary xs:decimal 135599.95 
[e| Dept integer 1 1 1 =) Employee 
[e| EmpName string i 1 Emphio xs:integer 222222 
(#4! [e] Address 1 1 Dept xs: integer 500 
[e| Tel <string> 1 1 999-999-9999 999-999-9999 ——— — = 
+) Address 
Add @ Local Element Salary xs:decimal 189599.95 
al G) Parsing completed successfully. bf 
HU 
iS. Navigator | [21 Problems | [E.. DFDL Test - Parse 3 B DFDL Test - Serialize 
DFDL Test - Parse: Runs the DFDL parser with the provided physical input data and sel Tips: 
Status: Parsing completed: Tue Jun 14 13:49:37 BST 2011 « Selecting an element in the DFDL editor will cause the parsed input to focus only on data pertaining to the selected element. 
Input «The view menu on the view toolbar provides options to control how the data is displayed in the view. Click the arrow icon on the toolbar or here to open the menu. 


« The logical instance that was created by the DFDL parser can be viewed by clicking on the Open DFDL Logical Instance View toolbar button or by clicking here. 
«The trace captured while running the DFDL parser can be viewed by clicking on the Open DFDL Trace View toolbar button or by cdicking here. 





Parsed Input 
Characters 


| ]Do not display this message again 














42 42 42 32 





23-The 3 4 
Richard «Hammond i 4 do oo tore f 
Jeremy -Clarkeson 5 J4 34 a4 a4 = 
Humphrey -Littleton 6 jo: 35 35sa5. 2 
f 
& 





| 2) — 
— seectonninf  DElimiters 
iplex) | Repeating index: [1 | | Range in parsed input: 0-669 Row: 7 | Column> h IQ h | fe hted 






Parsed 
data 
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DFDL Schemas for industry formats 


30 


HL7 v2.5.1, v2.6 and v2.7 

— Connectivity Pack for Healthcare 
IBM/Toshiba 4690 SurePos ACE v7r3 TLOG 
— DFDLSchemas on GitHub 


— DFDLSchemas on GitHub 
ISO 8583 (1987) 

— DFDLSchemas on GitHub 
— IBM Integration Bus sample vjeccages 3 GS) gt FR) BB 
More to follow ... 


Name 
=] [e] 1808583 
[=] ono SEQUENCE 
MTT_Version 
MTI_MessageClass 
MTI_MessageFunction 
MTI_MessageOrigin 
(=) & ) Bitmaps Group 
(=) oes SEQUENCE 
(+) [| PrimaryBitmap 
(+) [e| SecondaryBitmap 
(e| PrimaryAccountNumber_002 
ProcessingCode_003 
AmountTransaction_004 
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A message is a global element that models an entire document of data. 


Type 


integer 
integer 
integer 
integer 


PrimaryBitmapT ype 
SecondaryBitmapType 
<Type_n_LL> 
<Type_n_string> 
<Type_n_decimal> 


Min Qocurs | Max Occurs 


= es ee eld ed el Oe 
Ble lieP lei Pelee le le le le 
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Graphical Data Mapper 


Message In | 










eo Message Out 
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About mapping 


= Improved usability 

— Simple learning curve 

— Simple transformations are simple to create 

— Complex transformations build on concepts previously mastered 
= Improved capability 

— Builds upon “best of breed” mapping technologies in IBM products 

— Full XPath 2.0 expression support 

¢ Standards-based language designed for hierarchical data structures 

= Improved performance 

— Dedicated runtime engine 
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Mapping Node 


= Simplest way to transform a message 


= Graphical transformation editor 
— Shows source/target messages and database tables 
— Drag-and-drop fields/columns 
— XPATH, Java or Extended Structured Query Language (ESQL) can be used 


= Full XPath 2.0 scripting support 
= Properties folder and transport headers supported 


= LocalEnvironment supported 


= Submaps for reuse 
— Can be called from another Map 
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Mapping Node (continued) 
Mapping 
" Handles repeating elements nicely 
= Split/fork an incoming message 


= Database tables as a Source and/or Target 
— Inserts, deletes, updates, stored procedures 


= Map By Name provides automatic mapping 
- Identical Definitions — Either “tree copy” or individual fields 
- Similar Definitions — Selection based on field names and percentage matched 
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Creating a new map 


=" new maps are created by double clicking 


on a mapping node, or from the project 
view 


"= Dialog box launched to select source and 
target definitions 


— DFDL, XSD, Message Set 


= new map is opened in mapping editor 
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Er ad — | broker 


, rials Other Res 
A e LoansLib 


ia i (New... 


ae fe: eit ri 
cay Other Res 


Hi MapDB 
Eoxem a 


[-] uaa Brokers 
F)-24l yen 


Elves, defa 





New Artifact 


Create a new artifact, 


al Adapter Connection 
EB DFDL Schema 
Ey DFOL Schema From... 
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Specify source and target types 


= Select root elements 
"= Supports: 
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— Message Sets 
— XSD schemas 
— DFDL schemas 
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(9 New Message Map 


Select map kind and its source and target a 


Creates a map that can contain message and database tables as sources and targets. Properties, and 


optionally headers and the LocalEnvironment can be mapped. 


Type of map that you want to create: 
(* Message map called by a message flow node 
( Submap called by another map 





Select map inputs 





oo [eq Quantity [', InvoiceTransform, "] 
fee ls Report [", InvoiceTransform, “] 
oo le SaleEnvelope [", InvoiceTransform, "| 
beee “O& SaleList [", InvoiceTransform, "] 
bee ls SaleListCount [", InvoiceTransform, "| 
Freee Be Statement [", InvoiceTransform, “| 
bee es Surname [", InvoiceTransform, “| 

bo Bae oe mm [os Trailer [", InvoiceTransform, "| 

Been a [= Messages Sets 


Select map outputs 





Bl 0 FES0FDL and XML Schemas } 
been Ty Amount [", InvoiceTransform, “] 
bese [ce Article [", InvoiceTransform, "| 
fee om [oe Balance [", InvoiceTransform, "] 
Seve es Balance [", InvoiceTransform, “] 
a “Oe Category [", InvoiceTransform, “] 
Bean om [ce Code [", InvoiceTransform, "] 
bs Be CompletionTime [", InvoiceTransform, “] 
Seon ie Cost [", InvoiceTransform, “| 
bess if Le Currency [", InvoiceTransform, "| 
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The Mapping Editor 


4+ CreateReport 
*¥CreateReport 
hc: of Message Assembly 
<Click to filter... > 


 [€] Properties 
bf] SaleEnvelope 


[1..1] 
[1..1] 


Properties Type SaleEnvelope 


< Anonymous > 


Help system 


f= Properties 23 


CreateReport 





a Namespace: htto: /www.example.org 


rs Ag 
9 


== Tr} ar Ti 
at Teal. Tt 
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] Local map + 


=] [53 Message Assembly 
Fe <Click to filter... > 


[€] Properties [1.1] PropertiesType_Report 


Local map 


Has only one element as input (either a simple type or complex 
type) that can contain nested maps. The target can be either 
a single element or an array element but must be a complex 
type. The elements in the nested map must be mapped in 
order for the transform to execute, 


[ Do not show again 


ANONYMOUS > 


i+) a Amount 


[1.1] AmountType 
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Transform types 


= Local 


=" For each 
= If/ Else 
= Submap 
= Create 

= Join 

= Append 
= Group 
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E 24 
=e] Local map + 


a5 
Foreachs "| 


Conditions 


« fn * 
* FAElseif 4 
AjElse * 


Submap + | 
Create ~ “ 
ay 


¢ “Join ~ 


ks 


+ “| Append ¥ 


i 


F Group + 
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Move + 


Assign + 


Convert + 


&, fn:substring ~ 


% Custom XPath + 


J Custom Java + 


= Custom ESOL ~ 


Move 
Assign 


Convert 


XPath function — categorised 


Custom XPath expression 


Java — user defined 


ESQL —- user defined 
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Conditional mapping 


= Individual transforms can be configured to occur only if a condition is met 
— “Condition” tab on properties page 
¢ User enters an XPath 2.0 predicate 
¢ Content assist available 
¢ XPath 2.0 builder available 
¢ Mapping is only performed if predicate evaluates to “true” 


— pat cy oe itd 


le] Balance 1.1] decimal : 
ae Hed =) de] Amount [1..1]) AmountType 


af | Currency [1..1] string 







Currency 


Valle [0..1) double 


| Properties 52 \_[2) Problems EH Deployment Log ioe Navigator 


=. Transform - Move 


Cardinality The input element is evaluated against the condition. If the condition evaluates to true, the transform is applied to the input element. 
Condition SCurrency != ‘USD’ | Edit.. 


Order] 
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Conditional mapping 


" If/Else transform 
— Allows “else” condition to be mapped as well 


— “Grouped transform” containing as many else-if conditions as necessary 
— This is a structural mapping 


¢ Each clause contains a nested map 


Each condition is individually mapped 







(=| 72 | book book 


= <Click to filter... > 


(=) raft publication publicationT ype 

+l 

=e <Click to filter... > 
EFI isbni-10 


[1..1] string Aa 25 | Eelisbn-13 


XPath predicates are Navigate into nested map 
set in the properties view To configure transformations 
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The nested approach 


=i fa? Message Assembly SaleEnvelope = [ss Message Assembly 






= <Click to filter...> = «Click to filter...> 


# ae! Properties [0.1] PropertiesType ‘| & gl Properties [0.1] PropertiesType 


& fl SaleEnvelope [1.1] <Anonymous> [1.1] <Anonymous> 







# af! Header 1] <Anonymous> # pf! PurchaseList [L.*] <Anonymous> 


(Gforeach >)" 
# afl SaleList < Anonymous> ) 
@ gf! Trailer 






= BF! SaleList <Anonymous> & af, PurchaseList «Anonymous 


* <Click to filter...> * <Click to filter...> 


# gf! Invoice [1.*] <Anonymous> # gf] Statement [1.*] <Anonymous> 


=) BF) Invoice <Anonymous> = st Statement <Anonymous> 


 <Click to filter...>  <Click to filter...> 


sf Initial [1.4] string @ Style [0..1] string 
af] Surname [1.1] string ; @ Type [0.1] string 


a Gite 5.) Sane a =i afl Customer [1.1] <Anonymous> 


7 i 1 Initials [1.1] string 
Bal 1.1] decimal 
aie [La] string 


Cu 1.1] stri 
Bf] Currency [1.1] string if] Balance? [1.1] string 


= fl Purchases [1.1] <Anonymous> 
























@ ofl Article [1.4] <Anonymous> 


& sf] Amount [1.1] AmountType 
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Automap 


= Automates the task of producing 
transformations between source and 
target elements of the same (or similar) 


names 
= Useful for working with large schemas 
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0 Auto Map = 


Automatically map inputs to outputs 
Choose the options to automatically map the selected input and output elements. 
Click Next to select the transforms to create, or click Finish to create the transforms for all the 


a: 


Mapping Scope 
(* Map all simple descendants of the selected elements 


I¥ Group transforms into nested maps 
( Map the immediate children of the selected elements 


Name Matching Options 


i | Case sensitive 
I¥ Alphanumeric characters (Letters and digits only) 


Mapping Criteria 
Press Fil for more information when the names of inputs and outputs satisfy more than one criterion 


I“ Create transforms when the names of inputs and outputs are the same 


I’ Create transforms when the names of inputs and outputs are more similar than 
+ ]60  % match Default 


4 4 


[ Create transforms when the input and output names are matched to synonyms defined in a file 
BrOWSe,.. | 
ee 


= Back | Next > | Cancel | 
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Database Mapping 


= Mapper can work with data in a relational database 
— Supports DB Select, Insert, Update, Delete and Stored Procedures 

= Can select fields from DB tables based on data in the input message 

= Can modify DB tables using values defined in the map 

"= Graphical SQL “WHERE” clause and ResultSet generator 
— Can contain parameter placeholders to reference the inout message tree 
— Parameter values specified using XPath 

"= ResultSets are presented as source trees in the map editor 

= Input parameters are presented as target trees 
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Database mapping — JDBC configuration 


= Create JDBC Configurable 
service © 1am weosphere MO Epler (Celt 


File Edit Window Help 


7 Set Sec U r ty C red e nt | a S 5. MQ Explorer -Navigat 3 ~ [|| @ MQ Explorer - Content & “_¥ broker Administration Log 
. oY . ; 
— Ma S| setd bp arms aaiaeiaesaceaee Configurable Service MAPDB 


4 & Queue Managers 
J QM1 


= Toolkit and Runtime both connect Queue Manager Clusters Name MAPDB 


& JMS Administered Objects Type JDBCProviders 


to th e D B U Ss] Nn g J D B C Managed File Transfer connectionUriFormat jdbc:db2://[serverName]:[portNumber]/[d. 

& Service Definition Repositories | | connectionUriFormatAttr1 

ba s 4 & Integration Nodes connectionUrlFormatAttr2 

"= Now possible to specify a cl OR ee eT 
7 default connectionUrlFormatAttr4 
different database schema at fete 


‘§) JDBCProviders/MAPD) || gatabaseName MAPDB 


runtime from the one specified in U Administration Queue 
the map editor & Bar Files 










Properties QuickView: 











databaseSchemaNames useProvidedSchemaNames 
databaseType DB2 Universal Database 











databaseVersion 9.7 
= JDBC Configurable Service RWI) L, Sica ae 
——— jarsURL C:\Program Files\IBM\SQLLIB\java 

— databaseSchemaNames property > < Saree = 
— Specifies the database schemato 7\/\/ ™ — on 

use at runtime for all DB operations cerverName localhost 

or a delimited list of table/schema aS 

7 F : ast Updated: 17:28:51 
names | 


— lf left unset, uses DB default schema _ 
name (as for v8 GA mapper) 
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Database SELECT 
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Choose a database to select from Define a where clause 


Select a database available to the The where clause is used to extract only those rows that fulfill a specified condition, which is often the 
map, or obtain a different database. value of a key column in the database table. The value can come from other inputs in the map. The 


expression must evaluate to a boolean. 
MAPDB ~ | Add database... 


Table columns Operators Available inputs for column values 
#2 ACOLEMAN 4 [| $loan 
EH BOOKS 7 le] customerld 
(| E2 ACOLEMAN & ISBN El isbn! 
We BOOKS H TITLE le] return 
2 ISBN COPIES > 4 Hl $dbselect1 
B TITLE > > Fg ResultSet 
f COPIES 6a $loan-index 
Fl CUSTOMERS | 
fl LOANS 
Fa TYPES 
fl TEST.DOT 
Fa TEST?QUESTION 
Fl BOOKS2 


Choose the columns to include 
You must choose at least one column. 


SQL where clause 


ACOLEMAN.BOOKS ISBN = ? a 


~ Classify SQL warning 

If checked, the first SQL operation Plac.. XPath expression 
resulting in a database warning will be ? $loan/isbn 
treated as an error, and an exception 

will be thrown leading to the “Failure” 

transform, if present, being invoked ta 

process the exception. 


Treat warning as error 
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Database SELECT 


& 7] loan current-loanlype 


= <Click to filter...> 


le] customerld [1..1] string 


le] customer-name [1.1] string 


le] isbn [1.1] string [€] book-title [1.1] string 


[€] return [1.1] date ‘El Move + | AF] return [1.1] date | 


= ta] Select from MAPDB 





=? <Click to filter...> 











= Fe ResultSet [0..*] 
Bf TITLE = VARCHAR 
8 COPIES | 8 COPIES =——[.1] INTEGER _| INTEGER 


source tree representing 
The DB Select result set 
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Database Stored Procedures 


Invoke a database Stored Procedure 

Presented as a “complex” transform (function) 

Tools to discover Stored Proc metadata 

Presents “IN” and “INOUT” parameters as target tree in nested map 
— Wire inputs to stored procedure 


“INOUT”, “OUT”, ResultSet(s) and Return value as source tree in nested map 


Supports DB2 (GA), Oracle (soon), SQL Server (soon) 
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Database Stored Procedures ~~» | » le] x 








Select a routine in a database schema 
The following list contains all databases available 
to the map. Select a stored procedure or a user- 
defined function. 


Database |MAPDEB * | Add database... 


schema |ACOLEMAN id 


#0 Stored Procedure 
#0 ADDBOOK (4) 
#0 ADD_CUSTOMER (3) 
naan #0 GETBOOKS (1) 


Return a value 


eee EEE) 





Classify SQL warning | ADD_CUSTOMER 

If checked, the first SQL Of Type: Stored Procedure 
database warning will be Riordan niet 
an exception will be thro. 

transform, if present, bein| Parameters: 3 


exception. Parameter Name 


Treat warning as error| | NAME 
ADDRESS 
IDENT 









SG a | 
ee 





Es 








Define the Result sets for the selected Routine 
The Results sets returned by the Routine must be listed in the positional order they will 
be returned. You can set a description on each Result set. To enable mapping of a 
column from a Result set it must be defined. For more information... 


f 


Result sets list (max 0 returned) 


Order returned Description Columns defined 





Available table columns Columns defined for selected Result set 
&@ ACOLEMAN 
| BOOKS 
Fl CUSTOMERS 
Fl LOANS 

fl TYPES 


TEST.DOT 















Data Type 
VARCHAR 
VARCHAR 
INTEGER 
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Database Stored Procedures =~; 
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() Select a Database Routine 
Select a routine in a database schema | Define the Result sets for the selected Routine 
The following list contains all databases available The Results sets returned by the Routine must be listed in the positional order they will 
to the map. Select a stored procedure or a user- be returned. You can set a description on each Result set. To enable mapping of a 


| er ie | 















defined function. CREATE PROCEDURE ADD_CUSTOMER ( INOUT NAME VARCHAR(20), 


Database |MAPDB a Add database. IN ADDRESS VARCHAR (50), 
OUT IDENT INTEGER ) 
Schema |ACOLEMAN ~| Pl: BEGIN 


#0 Stored Procedure 
20 ADDBOOK (4) 
#0 ADD_CUSTOMER (3) 
naaine #0 GETBOOKS (1) 


Seu, (PP VeUS TOMER teri —— ( 
select id from new table ( 
insert into customers (name, address) 
Valves (ADP CUSTOMER. NAME ADP OCUSTOMER ADDR iS.) 


); 
Sal “ADD CUS TOMER NAME  — UPPER (ADD CUSTOMER 2NAME 
| | Return a value END Pl 








Classify SOL warning ADD_CUSTOMER 
If checked, the first SOL o 
database warning will be 
an exception will be throv 
transform, if present, bei 
exception. 


Type: Stored Procedur 
Max Result Sets: 0 


Parameters: 3 





Parameter Name Data Type 
Treat warning as error) | NAME VARCHAR 
ADDRESS VARCHAR 
IDENT INTEGER 
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Database Stored Procedures 


& 72] customer 





customer [. name 
$° <Click to filter...> Ay value oe 
identifier [0.1] string 
Sainame Al sting 
address es ea amass | 





[Sree = % Call ADD, CUSTOMER 


= <Click to filter...> 
72] address 


sk | {_SMove~ | 


[0.1] VARCHAR 


#3 ADDRESS [1.1] VARCHAR 
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stored Procedures — Returning ResultSet(s) 





CREATE PROCEDURE ADDBOOK ( IN plISBN CHARACTER (32 
IN Brite CHARACTE ( 
Ow pcop les INTEGER 
OUT pDUPLICATE BOOLEA 
D NAMIC RESULT SETS 2 
DECLARE cursorl CURSOR WITH RETURN FOR 
SELECT TEahe, ISBN, COPIES 
FROM BOOKS 
WHERE ISBN = ADDBOOK.pISBN; 
DECLARE cursor2 CURSOR WITH RETURN FOR 
SELECT TEahes ISBN, COPIES 
FROM BOOKS2; 
merge fnute BOOKS 2 ys lng 
enoike iva eS LADDER OS Re IL Sen 
ae : QOK SSI 7 Cw esha (CONE ALES 
on, BOOKSZ. ISBNe— EBOOK TISEN 
when matche Enen 
update set OE LES — COPILES =e bOOK COP TE. 
Wen OSE Mae eRe sare COPIE 
wees UP BOOR. TSBNG ERAQK. TITLE, tBOOK.COPIES) ; 
see ie COPIES Nie: sCOR Mss i BOOKS2 WHERE ISBN 
an “SDUPLICATE = trheé; en 








Classify SQL warning 
If checked, the first SQ 
database warning will t 
an exception will be th 
transform, if present, be 
exception. 


| Treat warning as err 
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Version 7 maps 





= Version 7 maps can be viewed in Version 8/9 toolkit 
— Read-only — cannot be edited 
= Version 7 maps can still be executed in Version 8/9 GA runtime 
— Converted in the toolkit into an ESQL Compute node 
— Executed in the ESQL runtime engine 
= Can “convert” V7 maps to V8 maps (requires version 8.0.0.1) 
— .msgmap -> .map file format conversion 
— Can then be opened in V8 mapping editor and modified 
— Will then be executed in the V8 mapping runtime engine 
«= “Assisted Convert” 
— Fundamentally different technologies 
— Cannot guarantee 100% accurate “migration” 
— Inserts annotations or “Task” markers to prompt user review or fix up 
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It's time for Labs 1, 2 and 3! 


"Applications and Libraries 
"DFDL message model tooling 


"Using databases with the Graphical Data Mapper 
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Decision Services 
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Combine the strengths of IIB and ODM for enhanced solutions 





¢ Reduced ‘e a 
rule cl 
decisions de 
busines 


‘to integrate 
irate systems 
echnologies 


ced integration - Rule go’ 





¢ High perform. 


3n and data enrichment Manage business 
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Transformation, dynamic routing and validation 





¥ 
Rule-based 
| Business Decisions 









ll 
ie 


Destination Destination 






Enterprise BPM | Business Business 
Application | System Portal L Application Application 


TAU Wea i ates 


a 


ie ib iathniaan 


Clients want ODM and Integration Bus deployed together to maximize 
performance and minimize latency : 


« Message Broker v7, v8 had I[AM9 Support Pack with ODM v7.5, V8, V8.5 


» NEW Releases of IIB v9 and ODM v8.5 greatly enhance this with no 
need for SupportPacs 
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smart dynamic routing 


Use Business Decisions to provide business level routing based 
on message conient 





Destination 1 


Request ——> 


Destination 2 


Destination 3 


— Least cost routing 


> Using business metrics and message content, choose the destination that imposes the least 
cost to the business while maintaining service level agreements 


— Route to appropriate destination 


> Analyse the message content and route to the destination best suited to fulfil the request 
based on business rules 
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Business-based message validation 


Use Business Decisions to provide centralized business level 
validation of message content 





Request ———> 


— Message validation 
> Perform complex validation of content of large documents based on business defined 
rules 
— Perform eligibility checks 
> For example, check that a received insurance claim is eligible for processing 
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Business-based message augmentation 


Use Business Decisions to provide additional information in 
messages based on business rules 





Request ——> 


—~ Message Augmentation 
> Use business rules to augment message content with information stored in decision tables 
— Intelligent Data Mapping 


> When there is no standard mapping between the content of two message formats, use IBM 
ODM to more quickly capture and apply the business rules required to perform the mapping 
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IBM Software 


stage 1: Define the initial business rule/decision service 





ay — — 































= . New F) ot Message Flow 
File Edit WNavic = ne 
Ze Manage Library references Wee. 
= = Message Model... 
Ci Be Manage included projects a |” sips Bi 
“t up a) ihe ati Ih Uh ak A iS Message Map 
ines —) A Fecus on Application Ee ESOL File 
HE Convert to Library fi «= Broker Schema View: Advanced + (7?) 





Adapter Connection 















Export A5Ds from Application EIS 
as a [] Database Definition = ., 
Convert to Integration Bus resources... "2 Data Lin ee = A decision service is a collection 
| = sald | ieee ee cae of one or more business rules 
Migrate (i BAR file 
Go Into = Integration Bus Test Client 
eae | se Decision Service WN eer double 
| : I rt - 
Paste Application (0.1) (targetServiceType) 
Delete Integration Service 
Move... Library 
Rename... 5, Data Analysis Project 
gg Import... 
“4 Export... 
Ey <Xpo 
Ctrl+N 
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Wizard guided task to generate a new decision service 








| Decision Service Parameters 
Container: | - oo ree . 


Decision se ST 


2 eee 
(Fiy~-HB@Sa :f :f : &#-O-Q- 
[Gb Application De £2 ™.. &2, Patterns Explo = Fi|| (5) StockTradexsd 
ea%- 
















Use the table below to customize the parameters available to the decision service. 







Application Development . 






EA] StockTradeRoutingApplication 
(= Schema Definitions 

Ga http://www.ibm.com/demo 

4 StockTrade.xsd 





Decision Service Parameters [>< | 
Nare Type Direction Verbalization 
StockTrade StockTrade {http://www.ibm.com/demo} INQUT the stock trade 















Parameters 






Decision Seer 

= 

Ge DetermineStockTradeRoute.rules Manage the parameters of the decision service. 
Name: Specify a unique name for the parameter. 
Type: Select a global element, global type, or simple type. The 
selected item's type will be used as the pararneter type. 


Direction: The direction of the parameter: IN, OUT, INOUT. 
Currently only INOUT ts supported for decision services 
authored in the IBM Integration toolkit. 





Verbalization: Specify a natural lanquage name (or alias) for 
the parameter; for exarnple, "the customer". This value is used 
to refer to the parameter when a writing a rule. 
For example: 
: Name: myCustomer Type: Customerlype Verbalization: the r 
Rule sequence |Paran, customer ee! 
To add one or more parameters, click on the ‘Add pararneters' 
button te bring up the selection dialog, 
To delete a parameter, place the mouse cursor in a table cell, and 
click on the ‘Delete parameter’ button. 





To edit a value, click the cell in the table. For the "Name" and 
"Verbalization" cells, type a value: for the "Type" cell, select a 
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Content assisted editor to author business rules 





File Edit Navigate Search Project Run Window Help 


C-BBeig if i %-OrQ~ i @-i f~ ij 





ES 
[a Application De £3 S. Ge, Patterns Explo | ~ [1 |) [S| StockTradexsd 5 
f®AbSs” 


rm 
Author one or more rules that will make up your decision service. 
Application Development ew... Press CTRL + SPACE to use content assist. 
StockTradeRoutingApplication 
(= Schema Definitions a 

fi http://www.ibm.com/deme Rule 1 [x] 

[8] StockTrade.xsd if ./ a) 

ag sais the maximum price of ‘the stock trade' is more than 10000 — 

fie] RouteRequest.msgflow Ea 
= Decision Services then set the target service of "the stock trade' to PREMIER ; —— i 


[= DetermineStockTradeRoute.rules 
‘ea else set the target service of 'the stock trade" to l an 






@ PREMIER 
® STANDARD 
“athe target service of <a stock trade> 





a pen TE 
26 Integration N 23 Sf Data Source Ex | | C1|| El Properties | [2 Problems 22 \_ B= Outline) 4) Tasks| EH Dg) 


ss Oi 0 errors, 1 warning, 0 others 





Bi tekemeatien ices Resource Path Location Type 
fl IBSNODE {& Warnings (1 item) 
ff, default 
d wi h 
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Decision services can contain multiple rules... 


| AA —— 


File Edit Navigate Search Project Run Window Help 


~-He@S ig iv i e-~O-GQ-ie-ih- Fre ero 





Bs & 
e ma Author one or more rules that will make up your decision service. 
Application Development New... Press CTRL + SPACE to use content assist. 





StockTradeRoutingApplication 
= Schema Definitions 
fe http://www.ibm.com/demo 
[8] StockTrade.xsd 
2 Flows 
Fel RouteRequest.msgflow 
2 Decision Services 
ES DetermineStockTradeRoute.rules 


20} [be] [>e} [Eq] =) 


=) (oe) [x 


: 





Rule sequence | Parameters | Additional Info 
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Embedding the decision service within a message flow 
| Te - “ en x | 
— —————————— 


(O-Hee (MP isk iw Or G+ i +i: Hr h- eer or 


Oo oO Oo Pluss Of oO 
mf oom Ge dé Wo ate | 











iy Application De. 5 aa 2 te, Patterns Explo = i RouteRequest.msgflow 2! ~\s 


Application Development ew. Al|Ts y a 
C& Favorites “a 3 

















a [A] StockTradeRoutingApplication 


4 (S Schema Definitions Ina WebSphere MQ StockTrade.QUT.STD 
4 && http://www.ibm.com/demo (ams JIMS 


[8] StockTrade.xsd 


F a Flows 





Fel RouteRequest.msgflow | fste ————_——__—_—— a 
a Ee nessa iT ar etetaene ines leteomenie 
StockTradeJN 


left DetermineStockTradeRoute.rules | 


al 


StockTrade.OUT.PREMIER 


fea Burciners Derctcinme it 
Graph) User Defined Properties 


2 Integration Nodes f Location Type 


fi) IBINODE 4) Warnings (1 item) 





Le StockTradeRoutingApplication/Decision Services/DetermineStockTradeRoute.rules 
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Embedding the decision service within a message flow 
= _ — a ° Sas) 
File Edit Flow View Palette Navigate Search Project Run Window Help 
‘+H eé @ if  t-OrQ~ ry Brie oro- 
: 100% ~+| %| # fel | Be ga oF The of oie | C) |! 
[Gb Application De £2“. G2, Patterns Explo | ~ Fi || HEI *Rou 
ge = = | ee oe Palette 











rs 
+O 


Favorites 
[4] StockTradeRoutingApplication Es 
Seti una WebSphere MQ StockTrade.OUT.STD 
fe http://www.ibm.com/demo ams JMS 
[S) StockTrade.xsd Ua HTTP 
eg —. " o CS Web Services , 
A utenequest.msqrow = |ae 
@2 Decision Services 13, SCA = : for pe 
EB DetermineStockTradeRoute.rules |g WebSphere Adapters StockTradeIN -_ 
Lp Routing Decision Service o| F 
oan StockTrade.OUT.PREMIER 
Transformation 
_§j Database 
(= File 
Lok TCPIP 
ing CORBA 
fer Pa 


nec Nericion i 
Graph User Defined Popeties| —=SSCS*~*~“*~“~*~‘“~*~“‘“~*S*S*SSSS 


(3 Integration N 22 ™., BB Data Source Ex 


2 Integration Nodes 


i] IBINODE 4 Warnings (1 item) 
re, default 
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o_O SEES ES 


| XPath Expression Builder 












Select the target f (0) jag and drop the nodes in the source 


wiewer below, 










f oO 


Choose a type (? = 















Data apes | XPath Expression Builder 







Select the target fromm the Schema viewer, Function viewer or Operator viewer and drag and drop the nodes in the source 
viewer below. 





Matching types: — 


[€] StockTrade 











Data Types Viewer “Path Functions Operators 













Data Types Ly} String | * 
b= $Root is. Boolean fi 
a4 (Add Data Type...) 4 Numeric if 
[e] Sto:StockTrade [XMLNSC] Le NodeSet = 










fe] MOMD: MOMD TYPE “a Axes < 
[€] Properties : Properties Type 


fel (KASTrancenard: IKAGTrancrnrt fern 


. 2! Problems| G= Qutline| 44] Tasks| EA Deployment Log 






+” Decision Service Node Properties - Decision Service 
A decision service node executes a collection of business rules that use defined pararneters. 


Use of this node ts subject to specific licensing requirements, click here for details... 


Decision Service Name* = DetermineStockTradeRoute.rules 
Ruleset* 
Parameters 
- Name Type Direction  Verbalization Data location 
| StockTrade —StockTrade{http://www.ibm.com/demo} INOUT  thestocktrade | $Root/XMLNSC/Sto:StockTrade 


| | Use DecisionServiceRepository configurable service 


‘i | TUPtestt ] | a LS = | | 
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Import an existing decision service 


Q) 
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Application De 


{= Integration 





— — — 


File Edit Flow View Palette Navigate Search Project Run Window Help 








Import an JBM Oper 
into a decision servi | Import Rule Application archive file 





a |[A] StockTri 
4 (= Sche 

r] h 

[ 





Select an import so! 
type filtertext = 


archive into a decision service 











Container: StockTradeRoutingApplication 


i» [= General 









a = Flow 
= | > ee CVS Decision Service: 
BE R 

a @© Deci 


() Select file from workspace: 
F = Indepen 
b> Gene 





[A] StockTradeRoutingApplication 
» (> Modeling (i) Independent Resources 
> & Plug-in Dey 
[> G& Profiling § 
> (= Run/Debuc 
i [= Team 

(> G Test 

> [> Web 

> [> Web senic 
i. YM 


Gee pacacal 
fi] IBON 
re, 





(@) Select file from outside workspace: 












?) Location C:\RDStockTradeRuleApp,jaq 


' ("| Overwrite existing Decision Service in specified cc 


ER Deploy... 
Team 
Restore from Le 
>a a] om | @ Nea 
Confinure 


_ 
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StockTradeRoutingApplication 


Import an IBM Operational Decision Manager (ODM) Rule Application 





(= Schema Definitions 


http://www.ibm.com/demo 


[S] StockTradexsd 


Flows 


piel RouteRequest.msgtlow 


@2 Decision Services 






erminestockTradeRoute.rules 
RDStockTradeRuleApp.rules 

(= Other Resources 
Independent Resources 
[= GeneratedBarFiles 
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Intelligent Rule Editor 


=== Decision Center fF HOME #8 LIBRARY 


cindy + 





L Pricing > main > Aquisition Promotion for NJ (v1.0) ® © 


@ > | Ley 


if 
the state of residence of the driver is "NJ" 
and the driver has never had their license suspended or revoked 
and all of the following conditions are true : 
- the number of accidents the driver has been involved in equals 0 
- the number of traffic tickets the driver has received is 0 
- the driver has completed a drivers education course , 


End Edit Details 


Natural language syntax 











then 
emit Offer promotion to retain customer with reason: “Increase market share for good NJ drivers" ; 
add a 0 % surcharge to San auto quote response> , reason: <3 string> 
E: : : 
a ee PANG) Co)aatlitemere)anle)(ciitels 
@ ‘the coverage quote’ 
Talitat=M=1d ce) mre [=i (-TeqiTeya) 
Severity ee 
Q 1 The rule is incomplete, fill all the placeholders. — 
Q 11 The word ";' is missing. 
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Decision Table Editor 


70 





Rule 


if 


=. Decision Center 


all of the following conditions are true : 


then 


- { the value of ‘the vehicle’ is more than 3 5000 and at most 5 10000 ) 
- (the deductible of ‘the coverage’ is $500), 


ft HOME gf 


set base premium for ‘the coverage quote’ to 3 110; 


— 


Lower 


$ 5.000 


§ 10,000 


$3 20,000 


$ 30,000 


50,000 
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Vehicle Value 


Upper 


$5,000 


2 10,000 


3 20,000 


2 30,000 


4 50,000 


2 100,000 








= Pricing > main > Collision Price Table NY (v1.2) ®% © 


1-16|16- 18] All 


250 
$500 
$1000 
$250 
$500 
$1000 
$250 
$500 
$1000 
$250 
$500 
$1000 
$250 


cindy + 






FQ 


End Edit Details 





4a 


Easy navigation across 





elena py ae) amr] e) (=> 


=o (UIM/=1(=1 0) mmr-lerd lola mael(= 


$ 110 
§ 100 
§ 130 
§ 120 
$ 110 
§ 140 
§ 130 
§ 120 
§ 155 
§ 145 
§ 140 
§ 170 
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Integration Services 
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Service discovery 


72 





Service discovery provides a common experience for describing service interfaces. 
=Interrogate IT systems for definitions that can be discovered 

— Data definitions, function declarations and communication objects 
"User selects, elaborates and refines 


=Service is described in the common model 
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service description 








Understand 
logical interface 





S 
O 2. 
At) » 
2. 7) 


Customer Address 


create | 






Exchange via 
physical interface 





= The service description can be shared with different tools and users 
" Allows users to: 


— Understand the interface: 
Logical description of available business objects and operations 


— Connector to exchange: 
Technical configuration describes real systems’ connection details and physical exchange formats 
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Integrating services 










































































= Integration services are ready for the consumer 
— Logical interface can be understood by the consumer 
— Physical connector is appropriate for the consumer's environment 
" Role of integration is relative 
— From aconsumer's perspective, the integration service /s the service 
— From the back office system's perspective, integration is a consumer of the service 
= Integration tools have a description of every service 
— Common model for all types of service 
— Discovery translates from consumer or provider's specific description 
= Providing an integration service requires 
— Service description 
— Implementation (flows, maps) 
= Consuming a service from an integration requires: 
— Service description 
— Access method ( node, procedure signature, service map) 
= Not everything is a service (for example, a file) 
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Integration Registry 


= Service descriptions (and WLM Policies) can be published to the Integration Registry 
— Facilitates collaboration and re-use 
— Integration Registry is hosted by the integration node 


= Populated by: 
— Publishing of discovered services (MQ Services) from Toolkit 
— Publishing of WLM Policies 


= Integration Registry is available from the Integration Toolkit and Web UI 








Microsoft® 





Integration toolkit 














a eT 
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Discovery workflow 





Server 
Connections 











Discover 








Technical 
Assets 











= User enters connection details 

= Connector discovers technical assets 
— Scheduled or interactive 
— White box or masked 














Elaborate 











Service 
Definition 








eee 


¢ User may configure the discovery step to omit irrelevant technical assets 


= Technical assets discovered 
— Interaction points (queues, programs) 
— Data Objects (tables, IDOCs) 
= User selects technical assets for elaboration 


— Selection task assisted by filtering, tyoe ahead, browse, search and so on 


— User elaborates definition of technical assets 

= Service definition created and stored in a catalog 
— Can be used to assist with message flow development 
— Provides policy attachment points 
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Publishing service to the integration registry 


| Ea Siesieane QSer 


A)(8. Schema Definitions 
Esper Gack ppetintions 
a ag a 


i CreditScoreM service, servic 





<— VadiniCreditService? service 


F Ei 1 “ Other Resources 
Integ ration fH ey WorkshopDBServiceLibrary 
Developer fH A WorkshopMOServiceLibrary 


F-l5] Bars 
| : cof CreditScore4pp. bar -> BaRFiles!C 
[+] fe Independent Resources 


un Integration Nod = é-4 y hee Data Source 


Ela Integration Nodes 





“Publish” discovered 
service definition to the 
integration registry 


{9 Integration Nodes 


l=! Es 


Integration Nodes 


Select the integration 


nodes that contain the 
New 


Open 
Open With 


Eh atg Integration Nodes 
hits fil IBSNODE 









a Select integration node 
ie of interest that hosts 
integration registry 


Plove,., 
Rename... 


Add Bookmark... 


ry = 


Application Deve te ae Patterns Explor Se YadinCreditScoreTest Al) CreditScoreMOService 52 


SEs” 


Application Development as 


of Services «| 
Ese || CreditScoreservice. service 
+ ore DBCreditScoreservice. service 
Other Resources 
|. a es 
 -(S. Schema Definitions 
fl-2* WSDL L Definitions 


Marne 


ik Message Configuration 


ae VadimCreditServiceZ. service 
“Other Resources 
as WorkshopOBServiceLibrary 


1 Cee a ee ee a 


CREDITSCORE REPLY _CREDITSCORE 
Operation 


ee eH Sere etre 


[2] Input 


ee Integrat 


Fb Gere Sel 


Ee Integration Nodes 
Bes, default 
ela] WorkshopCreditCheckService 
Fe -a WorkshopOBServiceLibrary 
el WorkshopMServiceLibrary 


Bal 


e* 1, Description & e” 2, Connect 


+ Interface 


Namespace 


* Operations 


Py CREDITSCORE_REPLY_CREDITSCORE REQUEST Operation 


+ ef 3, Select Resources * oe 4. MQ Configuration &* oe 5 


Configure your interface and advanced binding parameters 


CreditScoreMservice 


©) Use XML schema types 


Message 





Published service appears in the 
“Integration Registries” view 


fe] GREDITSCORE REPLY CREDITSCORE REQUEST Operati 


associated with the corresponding 
integration node (IB9SNODE) 


fel CREDITSOGORF REPLY CREDITSCOORF REOUEST Onerati 





co Integration Registries 2-5 (| Properties [sii Problerns 


Eee Integration Registries 


(=) Policies 
=) e Services 


foeee . DECreditScoreService 





© 2014 IBM Corporation 


IBM Software 


Import service from integration registry 








fas Integration Registries 





S2\ Cl properties (2 Problems] “Import” service from 1D Select Library lal Es 
J &| integration registry into Select Library 





Edt Integration Registries WO rkspace Select Library to contain your MQ Service 
Ell Integration Registry on IBSNODE 
@ Policies 
Fl Services Library: |Beta-DatabaseServicelibrary | Mews... | 
i DBCreditScoreService Beta-DatabaseServiceLibrar 
| nteg ratio i CreditScoreMOServiga seine Beta MOServicelibrary 


Developer hnmemininn Becca Select the library for 
importing service 
definition. 


MyM ServiceLibrary 





VadinserviceLib 
WorkshopDbServiceLibrary 
WorkshophoseryiceLlibrar 


fry mae 








Application Deve 25 












oe Patkerns Explor 


VadinCreditScoreTest alll CreditScoreMOService 25 4 ~ 7 


ef 1, Description & e 2. Conmect * e 3. Select Resources »* e 4.MQ Configuration & 





4pplication Development 


Retrieved service definition 
appears under Services folder in 





(Zz Configure your interface and advanced binding parameters 





fl £9 CreditScoreDatabaseService. service 
fel] DB CreditScoreservice. service 
W) Other Resources 


the navigator 











* Interface 


Namespace http: bempuri.org!CreditScoreM Service 


















& Schema CreFinitions 
-(&* WSDL Definitions 


“2 Flows Message Configuration (@) Use XML schema types Ol 
fal ESOLs 
8 Flaw Tests ~ Operations 


i 


“(> Services 
Eee || CredibcheckM Service. service 





Operation Message 






¥ CREDITSCORE REPLY _CREDITSCORE REQUEST Operation tS 







(+) UE] References ¥ 









‘| | 1 Input CREDITSCORE REPLY CREDITSCORE REQUEST 
= ene 











<= Previous 
Oe 1 
te (| Properties [2 Problems By History 


Fides Integration Registries 
Ell Integration Registry on IBSNODE 
i ap fs Policies 
Ae Services 


ht i] DBCreditScoreservice 














Fes Integration Modes 
lS] IBSNODE 
Aes, default 
[el -B| WiorkshoplreditlheckService 
[a WorkshopDBServiceLibrary 
aa WorkshopMOServiceLibrary 





ia Integration Registries 
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It's time for Labs 4 and 5! 


=Decision Services 
"Service Discovery 
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The rest of the story... 
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The rest of the story... 
Migration 
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Migration from WebSphere Message Broker V6.1, V7 and V8 


= Migration from WMB V6.1, V7 and V8 
— All development assets (for example, message flows, ESQL, DFDL, Java, Maps and XSLT) import directly 
¢ Right-click convert action for pre-V8 maps; some manual tasks may be required 
— Migrate brokers using a single command, or create new brokers for phased migration 
¢ No broker redeployment necessary when using built-in migrate command 
¢ All existing BAR files can be deployed to IB V9 brokers without change 


= Migration commands for in-place migration 
— Includes migration of configuration data including broker databases, queues and registry 
— Forwards and backwards migration of existing components, in situ 
- mqsimigratecomponents command (includes -t option for rollback to V7 and V8) 


= Flexible co-existence options remove the need for additional hardware when migrating 
— IB V9 co-exists on the same OS with all previous MB versions 
— MQ V7.5 required for all IB V9 brokers 
¢ MQ V7.5 supported with all V6.1, V7 and V8 brokers for the purposes of V9 migration 
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Conversion from WebSphere Enterprise Service Bus 


= Built-in conversion tools for WESB source assets 
— Initial emphasis on web services use cases (for example, StockQuote) 
— Advanced use cases over time; convert when appropriate for your installation 
— Open framework for user and partner extensions 


HA IIB _UtilityLib New 


-BA MQServiceLibrary : | = Simple workflow creates IB resources 
i. Export WESB PI from IID 
* —Henaeraee ll ve Import mediations into Eclipse Toolkit 
Right-click “convert” task to start conversion 
Follow guided editor to generate resources 
Task List will identify remaining manual steps 
lterate as necessary 











+ (6 CustomerLib 


+ 

ob 

+) (2 GetCustomerAndProduc 
(88 ProductLib 
‘?) 
i+) 
+ 


et ee 





CT StockquoteConversion.conversion 25 stockQuote_MediationFlow_getQuote_requestsubtlow 





wo Select WebSphere ESB projects F os 2. Confiqure WebSphere EsB resources * ~ 3, Configure globaloptians * « 4. Convert & 


5. Review results 





= Open Conversion Framework 
— Extensibility means more WESB primitives and resource types can be converted over time 
¢ No minimum version requirement of WESB source 
¢ Builds directly into WESB conversion editor 
— Design allows for future assisted resource creation from non-Integration Bus sources, for example 
— eGate Java collaborations and Event Type Definition, exploiting existing JAXB support 
— ICS collaborations, including ASBO and GBO model, exploiting new GDM pattern enablement 
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Simple Example Walkthrough — 1. Select WebSphere ESB projects 













BA I16_UtilityLib New > 

(| BA MQServiceLibrary ——————— 

+) (e) Independent Resources 

(=) (ese) WebSphere ESB Projects 
+) ih BackendLibrary 


Conversion session file (.conversion) — 














&-12) BackendMediations Migrate 
+) uh CustomerLib Go Into 
) ( GetCustomerAndProduc 

88 ProductLib Copy 






28 Salestib 


























‘e _) 
F 
whye cob Projects ane cependen f target Integration BUS Project name to change the default name. 
| WebSphere ESB Source Project Target Integration Bus Project 
vie TemperaturelTransiate IIB_TemperatureTranslate 
i Include referenced WebSphere ESB projects 
< Previgus Next = 


=" Select one or more WebSphere ESB projects for conversion 

= Target Integration Bus project name is configurable (recommend to use the default suggestion of 
prefixing with “IIB_”) 

= Referenced WebSphere ESB projects converted at the same time by default 


=" More granular view and options on individual resource conversion provided by next page of the 
conversion editor 
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simple example walkthrough — 2. Configure WebSphere ESB resource 
options 


“i 


I eae re =F 
_) *LIOAVERS IONS ESSiomu l conversion er 7 


1, Select WebSphere ESB projects * + 3, Configure global conversion options * 4, Convert WebSphere ESB resources * 5. Review results 
| Configure WebSphere ESB resource options, Filter resources by name or by using a wildcard character. 


WebSphere ESB Resources: 
type filter text Select the XML maps that you want to convert. Double-click on one map to see information on its usage analysis. 
(© Temperature Translate XML Map Usage 


la | MapCelsiusToFahrenheit_req_l.map - xslt/MapCelsiusToFahrenheit_req_l.map TemperatureTranslate.component 
4] Export ‘Export’ 
[. Component TemperatureTranslate’ 

(s] ¥SDAWSDL 

[+ XML Maps (all maps are selected for convers 


Conversion notes 


All selected WebSphere ESB XML maps will be converted to IBM Integration Bus XML maps. 
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simple example walkthrough — 3. Configure global conversion options 


1. Select WebSphere ESB projects * © 2, Configure WebSphere ESB resource options + CPS eine meet & 4 Convert WebSphere ESB resources * 5. Review results 


Specify how the conversion result should be recorded. 
- | Merge new conversion results with the results from previous runs of this conversion session 
* Mediation Primitive Converters 
Each mediation primitive will be converted to a message flow node or subflow. You can supply your own converter to convert mediation primitives. Double-click on one mediation 
primitive to see information on its usage analysis. 
Mediation Primitive Convert to Usage Converter class 
Errorinput Subflow placeholder Temperature lranslate.component Placeholder converter 
Input Input Temperature lranslate.component Built-in converter 
InputRespanse Reply (for example SOAPReply) TemperatureTranslate.component Built-in converter 
XSLTransformation Map TemperatureTranslate.companent Built-in converter 


* Export and Import Binding Converters 
Each export or import binding will be converted to a message flow node or subflow, You can supply your own converter to convert an export or import binding. Double-click on one 
export or import binding to see information on its usage analysis. 


Binding Convert ta sag Converter class 
Jax/Ws Export SOAPInput comibnvetoolsmfLconversionesb.extension. binding JaxWsExportConverter 


< Preyigus 
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simple example walkthrough — 4. Convert WebSphere ESB resources 


for conversion. 


Summary of the conversion configuration: 

















































































































WebSphere ES6 resource Type Option 
Temperature Translate Project AML Maps to convert 
Global option file//.. Menge conversion result 
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Value 


xsit/MapFahrenheitT oCelsius_req_l.map,xsit/MapCelsius ToFahrenheit_regqg_L.map 


false 
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simple example walkthrough — 5. Review results 


|) *LoOnmversions Soon i] onvemion = “a 








fi Review the conversion results. Complete all the to-do tasks to finish converting WebSphere ESB resources. 


@) Show all (—) Show resources with incomplete tasks 
Conversion summary 


yada Seat peacain ieee Mapping between WebSphere ESB files and Integration Bus files 


WebSphere E36 files Integration Bus files 


Export export | IB_ Temperature Translate msoqiow 
Request Type xsd | RequestT ypexsd 
ResponseType.xsd | ResponseType.xsd 

| ; _ TemperatureTransiate_CetsiusToFahrenher_request subflow 
isiriaiabaratih polos | _TemperatureTranslate_FahrenheitT oCelsius_request subflow 
ese ea = TemperatureTransiateType.wsdl 

| Temperature Transtate Type.wadl TemperatureTransiateType_InlineSchemat xed 

Temperature Translate _ Export? wsdl Temperature Translate_Exportt wsdl 
sta module | 1IB_TemperatureTransiate.msgnow 
xeitiMapCelsiusToFahrenheit_req_imap | xsit/MapCelsiusToFahrenheit_req_1.map 
xsitMapFahrenheitTocelsius req_1map xsitMapFahrenheitToCelsius req_1.map 
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Conceptual compare - IBM Integration Designer and IBM 


=Interface 





Configuration 


ke SOAP/HTTP | f 


[2 IB_TemperatureTranslate 
hres auch Name TemperatureTranslatelype 
Namespace | http:;//weaibm.com/Temperaturelranslate 


‘Operations “ #2 | Pee 

&) Error Handlers Operations and their parameters 

Ra Catch Message Type | Name Type 

Eo Failure + @ FahrenheitToCelsius 

Ea Timeout Cc FahrenheitTace.. _FahrenheitToCelsiusRequest | RequestType 
1 FahrenheitTote... | FahrenheitToCelsiusResponse _ResponseType 
© Y CelsiusToFahrenheit 
| &) Celsius oFahre... | CelsiusToFahrenheitRequest Requestlype 

@ CelsiusToFahre.. | CelsiusToFahrenheitResponse | ResponseType 








{ee Service. ‘@ Interface 








| E) Service \® Interface = 





2] TEB_lemperature lranslate $3 = al 
el TB_TemperatureTranslate * @ FahrenheitToCelsius + “ Request_Response 
| 4) Palette 


i Favorites TemperatureTranslateType_FahrenheitTotCelsius_Input MapFahrenheitToCelsius 





TemperatureTranslateType_FahrenheitToCelsius_InputResponse 





(GaWeb Services ~ 
Graph | User Defined Properties | 


(Service. @ Interface _ 


= IIB Integration Services have been specifically designed for their display in Toolkit to be familiar to WESB 
developers who are used to interacting with IBM Integration Designer 


— In IBM Integration Designer you can navigate to the mediation flow representing a particular operation by clicking its 
hyperlink. 


— In IBM Integration Toolkit, you can navigate to the subflow representing a particular operation by clicking its hyperlink. 
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It's time for Lab 6! 
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*WESB Conversion 
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Workload Management 


‘ a 
See ts 
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Making It easier to control the processing speed in Integration Bus 


- Message Flow processing rate control 
— Provide intelligent mechanisms to increase and decrease processing speed 





=o — Policy specifies goals for the processing rate of a message flow 
¢ DECREASE: Notify, Delay, Redirect 
* INCREASE: Add (increase threads), All (pre-emptively start all threads) 
¢ CONTROL: Restarting or reporting unresponsive flows or threads 
d N — Learning mode that calculates the best values for policy 


— Can be set at design time or changed operationally (CMP, command line and Web admin) 


« Allow more diverse Workload Management 
— Apply policy to different Broker artifacts: 
¢ Applications, services, individual nodes. 
— Scheduling like between 12:00 a.m. and 6:00 a.m. 
— Long term SLA like number of messages per day 
— Quality of service like batch versus low latency 





« Allow Workload Management to be defined in a policy separate from the message flow 
— Policy can be defined in the bar file on the Message Flow 
— Or in broker's new built in Repository 
— Use common repository component to allow policies to be stored in broker or elsewhere 
— Policy can be changed and used in broker independently of where it is stored 
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Message Flow processing rate control - Key rate terms 


Sending application 


Message flow 










——+o| g@ b—> 


: Inpu t Compu te iil CO) Ou f wr t 








‘Rate arriving in input node "Rate received in end application 


Rate ieaving the message flow 
‘Rate leaving output node 





Rate leaving application 
Rate arriving in message flow 


= There are various points in the flow of data from one application to another that the message rate 
can be measured and controlled 


= The Rate arriving in message flow is used as the controlling rate for the message flow: 
— Effectively limits Rate received in end application 
— Includes the total rates of all inout nodes of any type in the message flow 


| |= sas | = : eb , 
|2 = jo te Ey bat ig onli= Inputi = 


ex Retcontel SAP Input 
MQ Input2 _ Database Input |ij/ ine — | 7 Siebel Input > 


IN | ie TCPIP Client Inputi | a 


| 2] 3DEdwards Input1 Somkd Z 

Email Inputi |j|4™5 — | GenericHL7Input1 

IMS Input Medical Device Input SCA Input PeopleSoft Input1 
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Controlling integrations with policy —— 


WorkloadManagement 


i) Values that you do not define on this page are inherited from the message flow, if they ar 


= Integration Workload Management 
— Provide intelligent mechanisms to control processing speed 
— Most common scenario is to reduce back-end server load 
— Design allows more policy-based processing over time 
— Can be applied to new or existing integration data flows 


Policy Name BatchWorkloads 
* Targets and Limits 
Notification Threshold 


Maximum Rate 


= Policy defines threshold limits and relevant actions _ fesse Sass 

— Set thresholds for integration data flow throughput Additional instances 

— Specify actions at threshold, for example: Start additional instances when flow starts 
¢ NOTIFY: Higher (or lower) than threshold generates publication 
¢ DELAY: Excessive workload will have latency added to shape throughput 
¢ REDIRECT: Send excess to input node’s failure terminal or backout 





= Web Console used to manage WLM policy 

sophisticated behaviour controllable by broker WLM policy 

Workload can be managed across classes of message flows (for example, batch versus online) 
Policies stored in local registry, and dynamically configurable 

Developer can also specify limits as integration data flow properties 


200 200 200 

180 180 180 180 
160 160 160 160 
40 140 140 140 
20 120 120 120 
00 100 100 


io) 


8 
6 


aN 
oOo oO 





Nh 
io) 





0 0 0 
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Message Flow processing rate control - Notification TL) 


Rate leaving sending application Processing rate in the message flow 


200 200 


180 


Notification threshold set 4, 


120 on the message flow. 120 
100 Too 
80 80 
60 60 
| Ll.t ; 
20 2 
SPAR 


= A sending application generates a higher (or lower) than expected message rate 





= Configure broker to: 
— Send a notification when a threshold is exceeded or dropped below 
— MQ Pub/Sub mechanism used to decouple notification from consumers 
¢ Also write to Activity trace 


¢ And write to User trace 
Message flow 


= Action to reduce message rate up to the user: 
— Ramp back sending application 
— Email administrator to investigate 
— Stop message flow to protect receiving application 





Count messages processed every 20 seconds 


95 Discovering what is new in IBM Integration Bus V9 © 2014 IBM Corporation 


IBM Software 


Message Flow processing rate control — Delay 





Rate leaving sending application Processing rate in the message flow 


180 


Maximum rate set on 


on the message flow - 

100 

80 80 
60 60 
40 : : | 40 
20 20 
Pee 


"= A sending application generates a “bursty” message rate 





= A receiving application consuming the messages can handle the average rate but not short term 
fluctuations 


= Configure message flow to: 
— Limit the rate - Calculated on a message by message basis 


— Delay messages if going too fast 
Message flow 


i$ —~9)—-g} 
= Time is measured again before getting next message — \__ |DE|P 
IMs Compute TCPIP Client Output 


= Time is measured before getting message 





" Delay is made if time difference is less than the time required 
to keep to the maximum rate 
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Delay point before any data is ot or received 
orporation 
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Message Flow processing rate control — Redirect 





Rate leaving sending application Processing rate in the message flow 


200 200 


180 
160 
140 


the message flow 
120 YT 
100 100~ 
80 80 
” Limit action set to 60 
40 Redirect on the A0 
20 i : | : message flow 20 
» Saae DEERE ; 


= Messages can NOT be delayed because either: 
— Messages from the sending application can not be queued 
— Receiving application can not cope with the long term message rate 


Maximum rate set on 












= Configure message flow to: 
— Limit the rate - calculated on a message by message basis 
— Redirect messages if going too fast (send to the failure terminal) 


= Time is measured before propagating message Message flow 


= Time is measured again before propagating next message a yp 


IMS 
= Redirect to failure is made if time difference is less than the SAP Input2 IMS Request 
time required to keep to the maximum rate 





Redirect point before any data is propa ated 
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Managing unresponsive integration flows 





= Target unresponsive flows through policy to improve overall system reliability 

— Additional WLM option aimed at unresponsive integration flows 

— An integration flow can become unresponsive for multiple reasons 

¢ For example, waiting for external system, infinite loop, deadlock, malformed XML 

Le Policies 
Waiting —— 
for 
response 


WorkloadManagement 


* Unresponsive Message Flows 


—., ms = a : 
| oe) —® wae Processing timeout action Restart execution group 


Expose WS Generate COMMAREA Send to CICS Processing timeout 3 : | seconds 





= Flexible configuration, actions and reporting options 


— Specify threshold at which flows are considered unresponsive (for example, 30 seconds for 
processing) 


¢ Configured via WLM policy, or directly on the flow in the BAR file 
— Define action to trigger when flow considered unresponsive 
¢ Administrative notification through a new “timeout exceeded” event message 
If flow eventually continues through to completion, a second event is published 
¢ Restart the integration server (execution group) on which the unresponsive flow is running 
— new command option to forcibly stop integrations manually: mqgsistopmsgflow -f 
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Message Flow processing rate control — Unresponsive flows 








. Dead lock 


= Message flow processing can become unresponsive when: 
— Waiting for a response from an external system 
— Processing an infinite loop or a calculation that takes a very long time 
— Deadlocked between two resources 


= How to get out of this situation? 


— Kill the execution group process y aa Only mechanism in the past 
— Run acommand to force the stopping of a message flow = or REST, Web, CMP, Toolkit. 


— Define a policy which specifies the maximum time allowed for processing a message 
e Publish a report on what the Instance (thread) is doing and has just done 


¢ Optionally restart: Execution group, Message flow or Instance (thread) 
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Message Flow processing rate ne = Stopping an Instance 


Choose a stopping mechanism: i tonnes Transactions - 
: 7 : ~ & Exceptions : 


Please stop 
when you are 
ready 


No exceptions caused and 
transaction is completed. 
Standard message flow 
stopping mechanism since 
v2.0 


One exception thrown and 
transaction rolled back If 
exception Is not handled. 

Uses only safe thread 

mechanisms. 


Please stop as 
soon as possible 





Programming 
Domain 


Repeated exceptions and 
signals caused. 
Transactions will be 
rollback. Possibility the 
process will be restarted. 








Something is not 
right. 





Process restarted and all 
: | outstanding transactions are 
i terminated 





_-,. 


Operations oN. UY 
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Message Flow processing rate control — Stopping flow using a command 


=" masistopmsgflow in previous versions uses the Mark nechanism to stop flows 


=" Add anew option to allow: - Interrupt Force _ I ja nstead 


= It is possible to combine commands to escalate stopping the flow. For example: 


:\>mngsistopmsgflow MBSBROKER -e default -m test 


:\>mgsistopmsgflow MBSBROKER -e default -m test “1 Interrupt 


:\>mgsistopmsgflow MBSBROKER -e default -m test -1 force 


:\>mgqsistopmsgflow MBSBROKER -e default -m test -1 restartProcess 





= Also exposed through the following APIs: 
— CMP 
— REST 
— Web Administration Interface 


— IBM Integration Toolkit 
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Message Flow processing rate control — Detecting an unresponsive flow 


Message flow 


WLM Policy 


lf processing time 
Exceeds 30 seconds 
Then restart message 


Monitor when | 
flaw 1isina: 


na waiting for a response 
propagate finishes  StUCK In a loop or CPU 


intensive work 





= WLM policy attached to a flow to specify a maximum processing time for any instance 
(thread) after it has left an input node 


= Monitored using a separate thread that publishes a notification when a timeout occurs 
= Additional corrective action can be configured: 


— No action, leave it to user to perform an action based on notification 


_ Restart message flow: END or SEEN 0 (NESE . 
Stop message ow: AI > INI - (FSESENE se 
— Restart message flow instance (thread): Mark | o io 
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Message Flow processing rate control - 
Workload properties that can be set 


E 





= Notification threshold (Messages per second) 


— The rate at which notification will be published when either exceeded or dropped below 
— Default: Infinite 


= Maximum rate (Messages per second) 


iit — The maximum rate a flow will process messages 
Sec — Default: Infinite 


= Limit action 
— Delay or Redirect 
— Default: Delay 





HE] udp.msqflow Tg | - rs <a 





Manage 


Rebuild, remove, edit, add resources to bro || Workload Management 


























































































































Bo =) S =) Filter by: | “Type filter text> Notification Threshold (Messages per second) 
| Name Type Maximum Rate (Messages per second) 
el udp Application Si an ake 
ISI udp.msgflow Message flow Additional Instances 
[S| ENE! udp Start additional instances when flow starts 
2H) MQ Input 


itl) MQ Cutput Start Mode 


























Commit Count 
































Commit Interval 
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It's time for Labs 7 and 8! 


"Workload Management 
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The rest of the story... 


Web admin/analytics 
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/ @1em Integration 








IBM Software ¢ C' [5 localhost:4414/?logging=all#executionGroup/1/executiongroups/default 
IBM Integration 
Web visualization and analytics =e 
“= Integration Server - default 
14 pam Qoverview _— |v Statistics 
= Acomprehensive tool for web management a 
- ge default v Summary 
— Manage all integration resources from zero-footprint client (B Services 
Analyze integration performance in real time + g&) Applications » Throughput per message flow for last 20 seconds. Lastu 
: < : 2 ee iaielaal Message Rate V cote 
— Supported on a variety of browsers: IE10, Firefox, Safari... te (messagesis) 
— Complements MQ Explorer and WAS Admin consoles — Gia MonitoredFiow “X gigi 
p p a) @ Pattems ClCSChannelSample *% 23.87 
+| 5 Policy 
= Managing Integration Resources *| & Data 
‘ F ‘ ; +) &8 Security 
— View top-level integration node properties =] De] Monitoring 


Add/remove/change integration servers 2) Ef My Workspace 
Start/Stop integration data flows 

Role based access to control usage 

Advanced options include data replay, policy & monitoring 
Exploits underlying public REST/JSON API 


= Integration Performance Analysis 

— Operational experience; no developer intervention required 
¢ new and existing flows can exploit without change 

— Many metrics of integration flow available in real-time 
¢ CPU & I/O time shown by default in integration analyzer 
¢ Other metrics include thread, data sizes, errors... LEN | 

— Flexible display includes data tables and flow profile aaanioralar 
¢ Drill down to understand detailed behaviour 

— Exploits underlying MQTT web sockets technology 
¢ Asynchronous notification at low CPU cost 


CICSIPICRequestNode 


CCS Singing 
_ 
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Flow comparison 


Application - Coordinated Request Reply MQ Application 
O Overview lw Statistics 


Flow comparison 





* |hrougnput per message flow for last 14 seconds. Last updated at 11:2-°05 GM] standard lime. 


: Bac 
| e Rate CPU Time/ Total Input Active ‘ 
Flow name Time/ ae Rice | Tics kou Container 


WG BackendReplyApp *% 27.06 11 0.1 366 1 0 default/Coordinated Request | 
Request H 32.33 29.8 10.4 453 1 0 default/Coordinated Request | 


OA) oe 





* Nodes for all flows in Coordinated Request Reply MQ Application 


Total 

Average Total 
— Average CPU A ae CPU 
Node Time (ms) Elapsed Elapsed 


Time (ms) Time (ms) 


Invocat 


Time a Node type Parent Flow 
(ms) 



















GetBackendReply 0.1 0.1 94.5 17 1404 MQInputNode~ 


default/Coordinatec 
GetRequestMsg 02 01 172.3 1.8 1404 MQInputNode 


default/Coordinatec 
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Flow analysis — Line graphs 
n= Data Flow - BackendReplyApp 





Overview sw Statistics 85 Policies 
Flow analysis 


| 


* Session started 11:27:23 GMT Standard Time (2 minutes ago). Last updated at 11:29:27 GMT Standard Time Time range:) Session -~ 


Message Rate (messages/s) 


Message Rate (messages/s) ial 





Latest 299 8? 
Average 308.09 
Highest 329.10 
| | Lowest 267.28 
4771 PM 4-73 PM 4°79 PM 4:77 PM 4:79 PM 4°51 PM 4-33 PM 4-35 PM 
4-2? PM 4-24 PM 4°76 PM 4-278 PM 4°30 PM 4°32 PM 4-34 PM 
Average Elapsed Time Invocation (ms) 
0.15 eae 
Pir Average Elapsed Time/Invoce -* 
0.1275 
, oO . , Fi, > — I r — ay h Latest 0.1 
0.075 \ ~ NY | | | | — : Average 0.1 
0 05 Highest 0.2 
ae Lowest 0.1 
4-70) PM 4-74 PM 4-74 PM 4-76 PM 4-76 PM 4-30) PM 4-324 PM 4-34 PM 
4-71 PM 4-73 PM 4-275 PM 4:77 PM 4-79 PM 4-31 PM 4-33 PM 
Average CPU Time Invocation (ms) 
aa Average CPU Time Invocatior ~~ 
0.006 
Latest 0.1 
0.004 | | | 7 | | ~ fa [. | Average 0.1 
0.002 AYN : \N | VY OV TY \ | YI Highest 0.1 
| | r Lowest 0.1 
0 
4-7) PM 4:22 PM 4:24 PM 4-276 PM 4-235 PM 4-30 PM 4:32 PM 4:34 PM 
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Flow analysis — Nodes data and flow profile 


* Latest data per node 





Minimum |Average |Maximum 
Maximum CPU ¥ Maximum Elapsed or 
— Time (ms) Time (ms) ee 
Compute 2.1 3.1 ComputeNode 
SWIFT TO _AML_OUT Of 2.5 MQOQutputNode 
SWIFT TO _AML_IN 0.4 0.6 MQlnputNode 
SWIFT FAIL 0.0 0.0 MOQOutputNode 


* Flow profile 










SWIFT_FAIL 


I 


Compute SWIFT_TO_XML 
_OuT 
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It's time for Lab 9! 
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#Web Admin 
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